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I.  INTRODUCTION 


Suppose  we  have  an  S.-out-of-m  system,  where  m units  are  to  be  placed 
and  at  least  l of  them  should  function  to  make  the  system  work,  and  the 
units  are  statistically  independent  (see  Barlow  and  Proschan  (1975)).  In 
many  situations  several  brands  of  units  are  available,  from  which  we  have  to 
choose  at  most  m brands  and  draw  m units  of  the  system  from  them.  Note 
that  it  is  permissible  to  draw  units  from  a population  more  than  once.  We 
will  find  'optimal'  solutions  for  the  series  system  (i.e.  1 = n)  anc*  the 
l-out-of-2  system  when  each  unit  has  an  exponentially  distributed  lifelength. 

Let  iTj,...,ir^  (k  > 2)  denote  the  available  brands  and  assume  that  each 

unit  from  the  i-th  brand  has  an  exponentially  distributed  lifelengths  with 

mean  lifelength  X. * (i  = l,...,k).  Based  on  kn  independent  observations 

{X..}.  ,,  1 < i < k,  from  it.,..., it, , we  want  to  find  an  'optimal'  solution. 
ij  j = l — — l k r 

Because  of  sufficiency,  the  problem  can  be  reduced  to  the  one  based  on 
n 

(X.  = J X..:  1 < i < k),  with  X.  having  Gamma  distribution  with  mean 

i .L.  ii  - — l & 

-1  -2 

nX.  and  variance  nX.  . 
i i 

For  the  series  system  the  expected  lifelength  of  the  system,  when  we  use 

brands  (1  < i i < k)  for  the  m units,  is  easily  seen 

ml  _ |m  1 m - 1 - 1 

to  be  ( y X..)  , and  for  the  l-out-of-2  system  it  is  given  by  X.  ♦ X. 

1J  1 3 

(X.  + X.)  when  we  use  brands  tt.  and  it.  (1  < i < j < k) . Wc  will  consider 

v l j’  l J - j - > 

a loss  function  which  is  inversely  proportional  to  the  expected  lifelength 
corresponding  to  an  action. 

♦This  work  was  supported  by  the  Office  of  Naval  Research  contract  N00014-75- 
C-0455  at  Purdue  University. 


In  section  2,  we  will  give  the  results  for  the  series  system.  It  is 

assumed  that  the  loss  incurred  by  using  brands  it.  , ,ir.  (1  < i,  < ...  < i < k) 

i.  i — 1 — --  m =•■= 

1 m 

for  the  series  system  is  given  by 

m 

(1.1)  L(X, (i.  , . . . , i ))  = Y X.  . 

— 1 m .u,  l. 

J = 1 J 

Then  it  is  shown  that  for  the  series  system,  the  natural  rule,  which  draws  all 

the  units  from  the  population  associated  with  the  largest  sample  mean  life 

time,  or  equivalently  with  max  x. , is  uniformly  best  among  the  permutation 

l<i<k 

invariant  rules  and,  therefore,  it  is  admissible  and  minimax  among  all  the 
rules. 

In  section  3,  the  Bayes  rule  for  the  l-out-of-2  system  is  given.  Here, 
it  is  assumed  that  the  loss  function  is  given  by 

(1-2)  L(X,(i,j))  = (XT1  + X'1  - (X.  + X r1)-1. 

where  (i,j)  (1  < i < j < k)  denotes  the  action  of  drawing  units  from  and 
it  j . Furthermore,  the  prior  distribution  of  X^  is  assumed  to  be  the 
independent  natural  conjugate  Gamma-2  distribution  (see  p.  54  Raiffa  and 
Schlaifer  (1961)). 

The  l-out-of-2  system  with  k = 2 has  been  considered  by  Brostrom  (1977). 

He  constructed  a loss  function  which  depends  on  (X^.X^)  only  through  X ^ / X 2 to 
obtain  the  invariance  under  the  scale  change.  However,  it  should  be  pointed 
out  that  the  construction  of  such  a loss  function  can  not  be  done  for  k > 2, 
for  the  obvious  reason;  in  fact,  he  used  the  loss  function  L given  by  (1.2) 
divided  by  L(X^,  (1,2)),  but  for  k > 2 there  are  no  'intermediate'  actions 
by  which  wc  can  standardize  the  loss  function  without  losing  comparability  of 
the  different  actions. 


▼ 


Finally,  let  us  introduce  some  notations.  Let  x,..  <_  < . ..<x,, 

l * J (Z)  (k 

denote  the  ordered  observations  (x^  x2,...,xk),  and  ir^  and  X^  denote 
the  tt  and  the  X associated  with  x^,  i = l,...,k. 


2.  OPTIMAL  SOLUTION  FOR  THE  SERIES  SYSTEM 

In  this  section,  it  is  assumed  that  the  loss  function  is  given  by  (1.1). 

The  action  space  is  denoted  by  U = (fi.,...,i  ):  1 < i,  < ...  < i <kl  where 

1 m — i—  — m — 

(ij,...,im)  is  interpreted  as  drawing  the  j -th  unit  from  the  brand  tt^  (j  = 1, 

. . . ,m) . Given  x = (x.,...,x,),  the  posterior  risk  of  a decision  rule  d,  , 

-Ik  , 

which  selects  an  action  (i^,...,i  ) fc  G with  probability  1,  is  denoted  by 

m 

(2.1)  r(d,x)  = E[  l X |x] , : 

j = l j 

when  the  prior  distribution  of  is  given. 

In  this  section,  when  considering  only  Bayes  rules,  attention  can  be 
restricted  to  non-randomized  decision  rules  (see  Ferguson  (1967),  §1.8). 

The  following  result  considerably  reduces  the  number  of  decision  rules 
to  be  compared  for  the  Bayes  rule  w.r.t.  a symmetric  prior  of  X_. 

Lemma  1 . If  the  prior  distribution  of  X_  is  permutation  symmetric  on  (0,°°)k, 
then  the  Bayes  rule  d*  is  given  by 


r(d*,x)  = Min  Min  r(d  ,x), 

l<s<kAm  n €N 
— s s 

s 


,...,n  ):  n.>. >.  n > 1,  £ n.  = m,  n.'s  are  integers}, 

j=l  J 1 

for  j = 1,. . . ,s. 


where  N = (n  = (n, 
s —s  i 

kAm  = Min  (k,m)  and  d draws  n.  units  from  ir 


n 

— s 


(k-j+1) 


Proof.  For  s = l,...,kAm  let  us  define  Ug  to  be 


' Ls  = {(11 V nl*- 


>ns): 


n^,  1 -k>  ij'*for 


□ □ 


J § 

§ I 

‘ Si 


3-  CO 

¥.  | ! 

P s i 

- * r 

P V S <>>  i >. 


ceots 


where  (ij,...,is;  nj,...,ns)  is  interpreted  as  drawing  n.  units  from 
(j  = l,2,...,s).  Note  that  we  are  partitioning  the  action  space  L 

j 

into  kAm  components  U^(s  = l,...,kAm),  where  we  should  use  s different 
brands.  Again,  can  be  written  as 


b = U U , where  Cl  = { (i  , . . . ,i  ) : (i  , . . . ,i  ;n  ) fcU . }. 

b II  II  1 51  5 5 5 

n tN  — s — s 

— s s 

Note  that  the  loss  function  given  by  (.2.1)  can  be  written  as 


L(A,a)  = 7 n.A.  for  a t U . 

— ■ , J i.  n 

J=1  J -« 


Now  consider  a decision  problem  with 


the  action  space  (i  , the  above  loss  function  and  the  observation  vector 
— s 

x.  Clearly,  this  problem  is  equivalent  to  partitioning  k brands  ir^,...,^ 
into  s+1  subsets  (y^ , . . . , Yg , Ys+i)  where  Yj  is  of  size  1 for  j = l,...,s, 
Ys+j  is  of  size  k - s and  the  action  (i^,...,is)  corresponds  to  the  action 
(tn.  } {it.  },  {it:  1 < i < k,  i t i. , . . . ,i  }) . 

il  ig  i 

It  is  easy  to  see  that  this  component  decision  problem  is  invariant 
under  the  permutation  group,  and  that  the  loss  function  satisfies  the  mono- 
tonicity and  the  invariance  properties  of  Eaton  (1967)  with  parameters 


ei  of  his  paper  being  A^  (i  = l,...,k).  Since  the  density  f(x,0^)  of 

X.  has  monotone  likelihood  property  in  x and  0^  = A.*,  it  follows  from 

Eaton's  results  that  the  rule  which  assigns  j+i)  t0  ^or  j = 1>--*S 

and  Ti^k  s + i ) ’ * ’ • ,1T  (l)  t0  Ys+1  *s  **ayes  w.r.t.  a permutation  symmetric  prior 

distribution  of  0 = (6^,...,0^).  This  completes  the  proof. 

The  following  lemma  has  a result  which  is  of  interest  in  itself. 

k k 

Lemma  2.  Assume  that  X^,...,X^,  given  £ = (0^,...,0^)  t h c.  (-“>,«>)  , are 
independently  distributed  random  variables  with  X.  having  p.d.f.  f(x,0.). 

If  f(x,0)  lias  the  monotone  likelihood  ratio  (MLR)  property  in  x and  0,  and 
if  the  prior  distribution,  i(0|,  of  £ = (0.,...,o^)  is  permutation  symmetric 


on  fc  , then 


Et0(i^  111  > Ef0(j)  I’Ll  for  i > j, 


where 

Proof. 

Then 


E[0(i)|xJ  denotes  the  posterior  expectation  of  0 associated  with 
Let  = {0  fc  bk:  0(il  >_  0(  ^ 


(i) 


/ [0(il-0(j)]fC2i»0)dT(0)  = / t0(i)-0(j)]f(X,0)dT(01+  / [0cir0rjjJf(x 


= / [0(i)-0(j)] [f(x,0)-f(x,0’)]dr(0): 


k 

where  f(x,£)  = II  f(x.,0.)  and  0_'  is  obtained  from  0 by  interchanging 
i=l  1 1 

0 m and  0(-j-j»  keeping  other  components  fixed.  Thus 

F ^0(i)'9(j)  ^ JQ  J [f  Cii.Q) -f Cx.,0.’ 1 ]dx(£)  , where 

n(x)  is  a normalizing  factor.  The  result  follows  from  the  MLR  property  of 

f(x,0)  and  the  fact  that  0(i)~0(j-)  i 0 for  £ t 


REMARK  1 . The  MLR  property  of  f(x^,0^)  in  Lemma  2 can  be  replaced  either 
by  the  M property  of  f(_x,0)  in  Eaton  (1967),  or  by  the  DT  property  of  f(.x,£) 
in  Hollander,  Proschan  and  Sethuraman  (1977). 


REMARK  2.  If  0^,..,0^  are,  a priori,  positive  random  variables,  then  it  is 
easy  to  see  that  E[0^.  |x]  £ E^°(j)  I— ^ Eor  * — j • Therefore  in  our 
problem  E[X^  |£j  _<  E[Xy^|x]  for  i £ j,  if  the  prior  distribution  of 

k 

= (Aj,...,X^)  is  permutation  symmetric  on  (0,°°)  . 

The  next  result  follows  from  Lemma  1 and  Lemma  2. 


,0)di( 


THEOREM  1 . For  any  permutation  symmetric  prior  distribution  of  X on  '0,°^ 


the  Bayes  rule  is  d = d , as  defined  in  Lemma  1;  namely  the  Bayes  rule 

-1 

draws  all  m units  from  tt,,... 

) 

Proof.  It  follows  from  (2.1)  that  r(d  ,x)  can  be  written  as 

— s 


r(dn  ,x)  - E[  l n X |x] 

— s j = l J 


for  n fc  N 


Therefore 


r(dns-i>  - E[(-»*l)»(k)  . A(k.ju)|x) 


. E[(.-  n.)A(k).  ■>jA(k.jtl.|x)  - E[(n-S.l)A(k).  |x] 

s 

= E[  I (nj-l)  (A^k_j  + i) - 2a ( k -) ^)  1 2l' 1 i as  pointed  out  in  Remark  2. 

Thus  MIN  r(d  ,x)  = r(d  ,x)  where  d = d with  n*  = (m-s+1 , 1 , . . . , 1)  fc  N , 

n fcN  5s  s s n*  -s  s 

-s  s s 


l .e. 


(2.2) 


dg  draws  (m-s+1)  units  from  and  one  unit  from  each 


W(k-j+l) 

And  for  any  s:  2 <_  s kAm, 

r(ds-i>  - ■ Etj2  ‘‘(k-JurV1-0' 

Therefore  the  result  follows  from  Lemma  1. 


Cor.  1.  The  'natural'  rule  dj  is  uniformly  best  among  the  permutation  invar- 
iant rules. 

Proof.  This  follows  from  considering  a permutation  symmetric  prior  x which 

1 k 

gives  mass  j-,-  at  each  permutation  of  components  of  a fixed  vector  X fc  (0,“>)  . 


Cor.  2.  The  natural  rule  is  admissible  and  minimax  within  the  class  of 
all  decision  rules. 

Proof.  Since  the  permutation  group  is  finite,  the  result  follows  from  theorems 
in  Ferguson  (1967),  §4-3. 

REMARK  3.  Alternative  proof  of  Theorem  1 has  been  suggested  by  Panchapakesan 
(1978)  after  this  paper  was  partially  prepared.  His  idea  is  to  treat  the 
above  decision  problem  as  a product  of  m decision  problems;  namely 
i b =,  b,  x ...  xb  , where  i.  t,  b.  means  to  draw  the  j-th  unit  from  the  i-th 
brand.  This  can  be  done  since  the  loss  function  L(A^a)  for  a fc  b can  be 
written  as 

m m 

L(A,a)  = 7 A.  = y I.. (A, a.)  for  a = (i  ,...,i  ) fc  band  a.  = {i  } t b. . 

j = ! 1i  j“j  J “ J 1 m'  j j j 

Then  using  Lemma  2,  a simpler  proof  of  Theorem  1 can  be  done.  We  have  chosen 
to  retain  our  method  of  proof  for  other  independent  interest  since  this 
alternative  approach  can  not  be  done  if  the  loss  function  is  not  additive. 

REMARK  4.  If  we  consider  a loss  function  L, (A, (i, , . . . ,i  ))  = (m  Min  A.)  - 

— r 1—1  m , . . l 

m _ j l<i<k 

( £ A.  ) , it  is  easy  to  verify  the  monotonicity  and  invariance  properties 

j = 1 

of  Eaton  (1967).  Therefore  Lemma  1 holds  for  the  loss  function  Lj . Assuming 

k 

an  exchangeable  prior  of  _A  on  (0,«)  , namely,  given  B = 3,  A^,...,A^  are 
positive  iid  random  variables  with  p.d.f.  g(‘,3)  and  the  distribution  of 
B is  known,  we  can  prove  that  the  Bayes  rule  d*  for  the  loss  function  Lj 
satisfies 

r(d*,x)  = Min  r(ds>x), 
l<s<kAm 


(2.3) 


8 


where  the  rule  d^  is  defined  in  (2.2).  Note  that  this  can  not  be  achieved 


by  the  alternative  method  in  Remark  3.  Even  though  (2.3)  is  a considerable 
reduction  in  a number  of  candidates  for  the  Bayes  rule,  specification  of  the 
Bayes  rule  seems  very  difficult  except  when  m = 2.  One  interesting 
exchangeable  prior  is  assuming  an  inverted  Dirichlet  prior  distribution 

n a*'1 

i-i  1 


with  p.d.f.  t(A)  = 


T (otk+a) 


r(ct)kr(a)  (£  A +1)«k+a 


where  o > 0,  a > 0 are  known 


constants,  which  is  equivalent  to  assuming  that  A , ...,A, , given  B = 3, 

X K 

2 

are  iid  Gamma  random  variables  with  mean  a/8  and  a/8  . and  B has  Gamma  dis- 
tribution with  mean  a and  variance  a (see  Johnson  and  Kotz,  1972,  Page 
239).  Another  simplest  way  of  assuming  an  exchangeable  prior  is  specifying 
that  A^,...,A^  are,  a priori,  positive  iid  random  variables.  Some  numerical 
results  in  this  direction  for  m > 2 would  be  interesting. 


3 . BAYES  SOLUTION  FOR  THE  1-0UT-0F-2  SYSTEM 

In  this  section  it  is  assumed  that  the  loss  function  is  given  by  (1.2). 
The  action  space  is  denoted  by  G = ((i,j):  1 < i < j < k},  where  (i,j)  is 

interpreted  as  drawing  one  unit  each  from  the  brands  v ^ and  tt  , respectively. 
Furthermore,  the  prior  distribution  of  A^  is  assumed  to  be  independent  natural 
conjugate  Gamma-2  distribution.  Then  the  joint  a priori  p.d.f.  of  _A  is 

k „a  _ , -BA. 


(3.1) 


t(A)  = 11  [-^^A?  *e  *],  a > 0 and  8 > 0. 


Then  it  is  easy  to  see  that  the  posterior  p.d.f.  of  A^,  given  X=x.»  is 

k (x.+6)n+a  , - (x. +8) A . 

(3.2)  T(A|x)  = A.  1. 


It  follows  from  this  that  » • • • »X(k)  are>  a posteriori,  independently 
distributed  Gamma  random  variables  with  mean  (n+a)/(x^+B)  and  variance 

2 

(n+a)/(X(.^+B)  . Let  r(d,x)  denote  the  posterior  risk  of  rule  d,  given  x.. 

By  considering  = {(i,i);  i = l....,k}  and  Cl,  = {(i,j);  1 < i < j ^ 1} 
and  using  similar  arguments  tu  the  one  in  Lemma  1,  we  have  the  next  result. 

v 

Lemma  3.  For  any  permutation  symmetric  prior  of  \ on  (0,°°)  , the  Bayes  rule 
d*  is  given  by 


r(d*,x)  = Min (r(d1 ,x) , r(d2,x)}, 


where  d chooses  2 units  from  tv  and  d_  chooses  one  unit  from  tv,.  , and 
1 (k)  2 (k) 

another  from  tv„ 

(k-1) 

Now  we  state  and  prove  a theorem  which  gives  the  Bayes  solution. 
THEOREM  2.  The  Bayes  rule  d*  w.r.t.  the  prior  given  by  (3.1)  is  given  by 


(3.3) 


if  X(k~l)  + B -C(X(k)  + B)’ 
if  x(k.1}  * B > c(x(R)  ♦ B), 


where  c = if1  (0)  € (0,1),  H (c)  = E [Mi^i ] _ 2(n+a)  for  c > 0 and 

“,n  U +cV+cUV  3 

U,  V are  iid  Gamma  random  variables  with  mean  (n+cx)  and  variance  (n+a) . 
Proof:  It  follows  form  (1.2)  and  (3.2)  that 


rtd^x)  -|E[J(k)|x)  J !iSL_ 


r(d2,x)  = E[X(k)A(k-l)(X(k)+A(k-l))(X(k)+X(k)X(k-l)+X(k-l)1 


1 ,.tUV(U+rk  V)  , , X(k-1)+B 

X Tr  ■ t 5 \ for  rk  = 7"  ~+r — * 

(kl  1 ll%rkUV*rkV2  K x(k)  ' 


T 


r 


where  U and  V are  iid  Gamma  random  variables  with  mean  (n+a)  and  variance 

xfk-n+£\ 

(n+a) . Thus  r(d  ,x)  > r(d  ,x)  if  and  only  if  H (— — )<0,  which  is 

* 1 a >n  x()c)+3 

x n+6 

equivalent  to  — — > II  (0)  since  H (t)  is  a decreasing  function 

p ct?n  a,n 

of  t > 0.  Furthermore  it  is  easy  to  see  that 


Vn(1)  = Et  „-2V"  S ] -!(n+a)  < ° 


U+UV+V 


■ 1 


which  implies  0 < H (0)  < 1.  Hence  the  result  follows  from  Lemma  3. 

1 a ,n 

X1  xk 

It  is  easy  to  see  that  — — r-  ...  — are  marginally  independent  Beta 


x:+6 


V6 


random  variables  with  mena  n/(n+ct).  It  fellows  from  this  that  the  Bayes 
risk  of  the  ruled  s£ti^f).es  •*  • 


(3.4) 


r(dj)  = |(n+a)3_1F.[Z(n] 


<2  a 
~ 3 3 


where  Z^  is  the  smallest  order  statistic  from  a sample  of  size  k from 
Beta  distributions  with  mean  a/(a+n).  It  follows  from  (3.4)  that  the  Bayes 
risk  of  the  Bayes  rule  d*  in  (3.3)  is  finite.  Furthermore,  the  distribution 
function  of  X,  given  A t ( 0,°° ) , is  absolutely  continuous  with  respect  to  the 
marginal  distribution  function  of  X. 

The  next  result  follows  from  the  above  fact  and  a well  known  theorem 
(see,  for  example,  Brown  (1974),  Theorem  3.14). 


Corollary  3.  The  Bayes  rule  d*  in  (3.3)  is  admissible. 

Similarly,  it  is  easy  to  see  that  the  generalized  Bayes  rule  w.r.t. 
k 

d^  = H d log  A.  which  corresponds  to  the  vague  prior  a = 3 -*■(),  is  given  by 
i = l 1 

(3. 3)  with  a = 3 = 0. 


* 


REMARK  5.  If  we  consider  a loss  function  L_  ( i » j ) ) = i ( Min  A.)”1  - 
-1  -1  -1 

[X^  + A^  -(X^  + A^.)  ],  it  follows  from  the  same  method  that  the  Bayes 

rule  w.r.t.  the  prior  specified  in  (3.1)  is  given  by  (3.3)  with  c = 

Ga!n(0)  fc  (0)1)  and  Ga,n(t)  = 7 idbl  ~ + for  t " °'  wherc  U 

and  V are  iid  Gamma  random  variables  with  mean  and  variance  equal  to  (n+a) . 

The  remaining  analogous  results  can  also  be  obtained. 
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